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ABSTRACT 

This student^ assessment project establishes an index^ 
of the level of educational preparation of on-<iampus day transfer 
students at Seattl^ Central Community. College. Reading, writing, and 
arithmetic were chosen as indices of the level of academic 
preparation, and a self-report inventory was selected to measure 
academic motivation. Although participation in the study was 
voluntary, the 485 students tested in 30 different classes 
represented 56.9 percent' pf the enrolled students in those classes, 
by using cloze procedure,, it was determined that 40 percent of the 
students were experiencing difficulty reading their required 
textbooks. Sixty-seven percent of their writing samples were judged 
to, be unacceptable for college transfer, and competency in arithmetic 
as demonstrated by a subtest of the Comparative "^Guidance Placement 
Program, placed t^hese students no better than the 45th percentile on^ 
a national norm, 'bn the other hand, these same students appeared to 
be as motivated (on the basis of an Academic Hotivation Scale) as 
other average community college students across the nation. 
Subsequent reports will follow this sample of 485 students through 
the academic year in order to it^ntify possible relationships between 
the variables and performance. Out^io'r/RHH) 
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Preface 

An institution with as diverse a student population as Seattle Central Community 
College must continually re-axamine its mission in light, .of student and faculty feed- 
^b^ck. One 0/ the major concWns of faculty has been tike low level of educational 
preparation students often demonstrate in their, classes. 

Concerns range from problems regaizding poor bas/rcv skills to lack of motivation 
'and apathy. While the lack of motivation may ^a;^ly beyond the reach of our 
influence (having socio~psychological\implicalions)^oor educational preparation * 
is not. In this area the college can maKe^an^mpact by making available special 
developmental programs.^ Nevertheless, such programs i\i this time of reduced 
revenues must be approached with clear vision and careful planning. Central to 
such careful planning is reliable information. 

On September 24, 1975^ ^ research prqject was begun consistent with and supported 

in large part by the goals and the resources of the AIDP supplementary grant. The 

\ 

objective of this proj^t is to gather baseline data regarding the level of edu^ 
cational pfreparation of SCCC students in academic transfer and to evaluate certain 
assessment tools as measures of students' basic skills and academic motivation. 
The project was conducted as a cooperative venture between Student Personnel Ser- 
vlce^, the Educational* Development Office, and the Office of the President. 

Dean Leroy Fails, Dr. Karen Spring and Dr. Hon Hamberg contributed professional 
tttn6 and energy above and beyond their normal institutional responsibilities. Iji 
pai;^ticular , Dr. Hamberg provided technical counsel and coordinated the scoring and 
processing of the test data. / 

Selection of the -Testing Instruments 

^' * Reading,, writing and arithmetic were chosep as indices for the measurement of 
the level of academic' preparation. It was assumed that competency in such basic 
skill areas is prerequisite to *the student success In a college curriculum; 



a self-report inventory was selected to measure academic inotivation. 

\ 

To assess students ability to do basic arithmetic operations, k sub-test of 
the Comparative Guidance Placement Program, published by the ^xjucatiortal Testing 



Service, was chosen. This mathematics test assumes one year of high school algebra- 
It is specifically designed for community co^ege students and is one of t\^ nx^st >^ 
widely used across the country. It has excellW: test properties inc\^ing rt^ti(^nal 
norms to which our particular student data could^be referred. One half Of the t;est . 
is devoted entirely to basic arithmetic operations while the second half samples ^u^ 
dent knowledge of basic hi^h school algebra. It was felt that whatever instrument 
was chosen it should contain a sufficient number of items to give a clear indication * 
of the student's ability to do basic arithmetic. The CGP mathematics test "D" does. 

In selecting an acceptable reading test many factors both practical and theoreti- 
caT needed to be considered. For example, most 'reading tests are n6t , writ ten for an 
adult population nor is a grade level achievement score particularly meaningful for 
a thirty year old student... After reviewing many approaches to assessing student^' 
reading ability, the one approach which se.ecned to make the most sense was to follow . 
Cloze test procedure. Cloze procedures have several, advantages over the use of 
standardized reading tests. For example. Cloze , tests afe based on the materials 
studeirfs will actually read. Thus a Cloze t4st in psychology measures the. students 

ability to read his psychology textbook. Secondly, this measure of '^ability" is a 

♦ 

measure of competency not just performance. As David McCarthy, a reading specialist 

at Lower Columbia College points out: * . , * 

"Traditional .and standardized reading tests measure a reader's 
response to a .number of questions that arfe based on and derived 
fpom a reading passage. However,' such tests are not measuring 
the ability of 'the reader to process the language itself, but 
merely the result of that processing which is assumejd to have 
taken place in order to answer the (Questions posed.".! 

Insomuch as the passage chosen is representative of the textbook as a whole, 

the criterion standards will indicate the student's ability to read the book as a 



1 • * * 

David McCarthy, Reading Levels of Vocational Student, (Mimeograph, Lower Columbia 
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whole. Toward such a caneful selection process l^aren Spring, Central' s' Reading/* 

Curriculum Specialist, tocusgd.her technical expertise. From' the.-required text- 

V books to he used by fall q^rter classes in the test sample she chose from each 
'\ . ^ ' • ♦ . ^ 

ten pages at rando/n; theti, for each page she administeretjl the Fry Readability" 

Scale/ The Fry Readability Scale gives a reliable indication of the grade leve^ 

m 4 „ J. 

at whjch any particular passage is written. A passage was, then chosen which reflected 
the most frequently occurring grade level* of the ten passages. - . * 

The following Cloze criterion levels were used in this study: Independent 
Level 45%\^r more were correct score at this level means the student is pro- 
bably able to f^ead the passage on his own without too much troub>e. Instructional . 
Level — 35-44% — students on t,his level c^ probably handle the text so long as 
-they receive sorne help from their\^nstructor. Frustraftion Level -- below. 35% -- 
\below this criterion the student will probably find his textbook fmjstrating to 
read even with assistance. These criterioo'lev^ls as described are well researched 
and suitablp for coVunity college textbooks .\ • * 

Turning now to the writing text, the problem of selecting a relevant and 

accurate test instrument was especially difficult. We needed a writing test that ; 

would be designed to measure competency in spelling, punctuation, capitalization, 

etc. --.in short basic grammar. However, we were also concerned with what we 

called intermediate and organ-jzational ^rrofs (e.g. vague pronoun reference, faulty 

parallelism, unclear presentation of an i^ea, failure to develop a point,^ lack of : 

connection between cause and effectVelationships , etc,.). White there are many 

standardized writing tests from which one ca\ choose, few, if any, provide analysis 

■ ■ 

of such organizational and intermediate errors. Consequently, we chose to take what 



'John Bormuth,' Personal Correspondance to Karen Spring* (Smith) , May 1974 
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seemed to be a simple but direct approach to 'the problem--we -asked the students 
to*write. * ^ 

• Students were given two short "stimulation" paragraphs and toW tp respond 
to one with three t^ five shor't paragraphs reflecting their feelings or opinions. 
I n^. such a fashion, we hoped to get and did receive actual writing samples from 
students. It is upon these writing samples that certain observations and judgments 
about their abMlity to communicate via the written word have been made. 

Finally, we wished to establish some iridex of a student's motivation toward 
his/her academic studies. We reviewed numerous tests ranging, from self-concept 
scales, to locus of cc^itrol inventories. Most of these tests involved more time 
commitmeht on the part of the students than we could legitimately expect.' As a 
workable compromise, we chose the Academic Motivation Scale, a subtest of the 
Comparative Guidance and Placement Program. The Academic Motivation Scale is . 
based on , the student ' s perqept'ion of his/her^high schbol effort and a self- 
'reporting of his/her study techniques. It has proved helpfulin predicting college 
grades particularly for students in transfer programs. Although the scale is 
copyrighted by E.T.S., Seattle Central Community College received permission to juse 
it in this pilot project free of charge. It has national norms and other corollary 
research materials which should^be of assistance as this project continues through 
the year. ' • 

Selection of the SaimRle : 
The student population of interest was identified as on-campus-day. academic 
transfer. The research problem wak to draw a sample that would be as representative 
as possible. Since no feasible wayjexists'to^ randomly select students from that 
group, a decision was madte to select Vhat hour\of the instr"uctional day containing 
the most acadeiliic transfe»^ classes. From the c\u)*se Master, it was determined 

■ . / \ . ■ • ■ • 
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that nuire academic transfer courses (aHot^l of 33) were offered at the y d'clock 

hour than any other tjme slot. Letters requesting participation went out to all 

33 faculty members. Jhe response and cooperation was excellent. All faculty 

members* agreed to rdSrrange their instructional schedule in order that the testing 

experience could be ( f fered during the 9 o'clock hour Wednesday, September 24, 1975. 
• i * 

All in all, the projfect involved 30 sections, four testing instruments and an 

J ^ 

opportunity to ask 352 students to volunteer 50 minutes of their time. Simple 
statistics, but a unique and unusual opportunity to. gather valuable institutional 
data about a. large segment of our student population. 

• I Assignment of Testing Instruments 

The C.G.P. Mathematics Test "D" is a 45 minute timed test. J\]e writing and 
Cloze tests, whichfare open 'ended, nonnally take between 25 and 35 minutes. The 
"motivation scale takes between 6-8 minutes to complete. In any case, it was'clear 
that it*weu-ld not (be possible, within one class period to acjminister all four tests 
to every stucjent. Consequently, it was decided to randomly assign the writing 



tests. Cloze tests, \and the math test to the 30 sections. It was felt that such 
a random asscignment would provide a sufficient amount of time Vor the students to 
adequately respond toltfie testing instruments. Parenthetically, such a rdn^om 

■ / ' ■ ' 

assignment wotild be the best way to avoid biasing scores were one to assign tests 
to classes whose curriculum might correlate with tha testing instruments. ("I.e. \ 
math to math, writing English, etc.). The- following grapih indicates th^ numbeih 
of sections assigned toleach of the testing instruments, the number of .students in 



those sectfons, the number of students taking the 



the percentage of the s 



tu- 



dents responding to the Ipest. P)^se! note thiStx given the length (45 minutes) of the 

*Three sections turned out to be smaU-fn'dependent study/project orienteti'cour^. 
seldom meeting as a groupj at any one time."" They were not included in the study^ 
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C.G.R. mathematic test the Academic Motivation Scale was administered to only those 
sections receiving either the writing test or the Cloze test (reading).. 



Figure 1 
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Test Instruments ^ 


Number 
of class 
Sections 


Number 
of 

Students 


Number of 
Test 
Taken 


'% 
of 

Response 


1 ^ 
Writing Exercise 




323 ' 


189 


58.5 


2 

Cloze Procedures 


8 


221 


154 ' 


69.6- 


^ C.^G.P. Math Tes^ ! 


n 


308 


■ 141 


f 

! 45.7 ' 


Total ' 1 


30 , 


852 


' 485 


j 56.9 


4 

Academic Motivation 


(1+2) 

; ' 19 


(1+2) 
544 


321 


/ 59,0 




On^ of the more significant points about , the research project is the percentage. ' 
of students who chose to participate — 56.9%. In fact, in sixteen, of the thirty 
sections, the percentage of student responsev v/as above 60%1 It is fair to say that 



for three ^of the four indices this student sampTTreRresents a majority of academic 



trajnsfer s 



tudents^ 



in those 9:00 a.m. class sections. One word of caution as we move 




e results; tfve results will tend to be liberal estimates. That is to say, 
^was the percentage ^f student response to have equalled one hundred percent it 
is more than likely that the sample mean (average) would have been lower (e.g. 
students w|io have histories of poor test performance do not tend to take tests 

if those tqstSv-are Optional). Still, the results of this study are based upon 

' I' • • \ 

thb majority (j>f stuqppts in academic transfer classes at the 9 o'clock hour. k 

Ta th^ extent that these students are representative of other tran^^fer students at 

otSer periods of the day will be the degree to which .any generalization about all 

acMemic transfer students ^it SCCC can be made.* The inductive leap must be 

mad^ witn cautio n.^ ' 

— ^ — 

* the process of collecting demogranhic data on this student sample has alr^ady^ 
begun an^ will be reported this sm^ing. 

/ 8 . . - y 
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The Results 



Reading: ^ * 

9 

Cloze tests were administered in eight classes. Figure 2 is a summary of the 
results;* Plerfse note that two classes are not included in the aggregate profile. 
In class "G" a typographical error was found in the test itself and while its \ 
affect upon student performance was probably insignii;icant (vis-a-vis the testes ^ 
readability) it qualifies and thus limits the reporting of those student scores. 
In- class *"H" the wrong Cloze test was administered. ■ .\ 

Figure 2 



Class 


Class. 
Size 


Number 

of 
Tested 


Res]}onding 


Grade Level 
■ of ** 
Text Material 


ef 

10 

at 

Frustration 


% 

i at 
Instructional 


at . j 
Independent 


\i 

Avera^g 
Score 




25 


23 • 


92.0 


College 


65.2 


- 30.4 


\'4.^ / 


•11.94 


, B 


26 


.26 


100.0 


College + 


61.5 


\ 15.3 ■ 


n — ' . /' 

■ 23.0- 


, 17.53 


C 


40 


27 


67. S 


Col lege 


33.3 


\ 'V . 


29 .•6 \ 


: 19.18j 


0 


17 


11 


64.7' 


9 th 


18.1 


\ 27.2 




5 


23.09 


t • 

f 


19 


15 


78.9, 


College + 


20.0 


\ 6.6 


\ ^ 731! 


3 


^4.26 


F 


"24 


14 


^8.3 . 


8th 


' 21.4 


\ 35.7 


4/) 


3 


?1 .r-1- 


Tor X 


151 


116 


76.8 


12 + 


\ 41.3 


^25.8 .\\ 


32.7 


19.60 


G 


32" 


31 


96^8 • 


College 


\ 96.7 


• 3.2' Vi 


« 

0.0 


9.58 


H 


i 30 


7 


18.4 / 


College 


42.8 


. 28.5 , \ 


?8.5 


19.. 00- 



Frustration Level * \= 0-17 correct \ 

Instructional Levefl ^' 18-22 correct * 

Irjdependent Lev.el I =^23-50 correit 1 

\ 



.** based upon the Fry Readability Scale 

In reviewing this chart one laist keep in. mind that a Cloze test is simply a 
match between the student and 'the tjextbpok required for a particular course. 
While Cloze test scor^es correlate closely to standardized achievement tests 1n^ 



reading (e,g. correlations range from- r68 to .83) it would be inappropriate to 
compare students in a Piiysics class with students in an English class. The point 
is that each textbook varies in its level of , readability and the degree to which ^ 
, its vocabulary is more or less tamiliar td-the individual student. Thus, the 
variability between classes regarding the percentage of student functioning ^t the 
frustration level is not unexp^ected. The .great strength of a Cloze tfest procedure 
is the .information it provides an individual instj^ctor about the match (or mi\- 
match) between his/her selected textbook and the reading ability of student in his/ 
her class. In order to maximize this infomjatlc^n individual re)^orts have been 
sent to participating instructors.. However* what do these Cloze ^tests tell us abo\i^ 
-our aggregated sample of 116 students? Encouragingly, we, find that the mean or 
average score for the group is 19,6 comfortably wi^thin the intei^^al defined as 
Instructional. Nevertheless, they also tell us ihat 41.3 percent o A these same \ 
students received Cloze, scores wKich placed them at the frustration V^vel.^ In 
short, over 40 percent of the students sampled, on the bdsis of cloze test^proce- 
dures^» were found to be either uTiable to read their required textbook or can read,, 
them only with extreme difficulty.* It is also of interest to note thaf -for tm ~ 
of the three sections achieving high mean scores (21+) the grade level^ of the 
required-reading material was* below 10 grade. , \^ 

Mathematics 

The Comparative Guidance and Placement Program' s mathematics te^ "D" con- 
sists of computation and elementary algebra problems and is focused toward stu- 

dents who have studied algebra for one year. It is the middle difficulty test 

\ ' 

in t|ie ,CGP program and roughly equivalent to the Cooperative Algebra I test 

\ \ t ' ; \ 7 , 

|^ese|itly ii;sed for student placement in Mathematics 099 and lOTy 

* ^ow much- such a problem may effect a student's grade or his/her performance in 
tlas^ is debatable. See -Karen Spring's article ii) the Joiirgal W Reading , 
\olum^\9r No. 2, November, 1975, p. 131 - 136. ^ - \ 

. 10 
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The C.G.P. mathematics test "D" is staii(||frdized and possesses national norms' 
fov community college students. Those pprcentr^' rankings were useful in the 
^ construction of the following table: ^ 

' • ■ - . Figure 3 



\ 

Class 


Class 
Size 


Number 
Tested 


Respoase 


Averfige 
Sco^e 


, Peer \ 
Percentile Rank 


Liberal Arts 
Percentile Rank 


I ^ 


37 


2 


5.4 


29.00 




• • • 


J * 


32 


, 17 . 


5'3.1 


36.18 


igT ' 


32 ' 


K 


24 


-11 


45\8- . 


62.09 




92 


' L 


.26 


18 


69.2 


35.39 


m 


32 ■ 


M 


26* 


15 


57.6 


32.20 


31^ 


22 




23 


15 


' 65.2 . 


42.73 


32^ 


49 ' 




15 


9 


60.0./ 


35.00 


\ ' 39^ 


32 


• \ P 


36 


23 


63.8 


34.52 


( NA 


32 


Q 


25 


25 


1.00.0 " 


51.76 • 


,51-1 


72 ^ 


R 


37 


fl 


2.7 


28.00 




y 


S 


27 


5 


18.5 


41 .80. 


NA 


46 


lor X 


308 ' 


141 45.7 


40.83 


NA. 


45 



\ 
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' 1 . Scjence/Math 

2. Fine Arts 

3. Health 

The math test was the one assessment instrument in this study th^t failed 



to achieve a fifty percent or majority student response, but clearly the lack ol' 
participation i>i three classes (I, R, and S) skewed the average. Still,! il: does 
s^m itjiportant to recall a point made in the beginning of this report: if \he 
^percentage of response had been higher most likely the average test score fo)r the 
^total group would have been lower. Obviously, this is hypothesis and the reader 
may form his or her own. Nevertheless, on the basis of an N of 141 (45.7% of the 
, total student, enrollment in eleven sections) J this sample of Seattle Central 
academic transfer students ranks in the 45th percentile on national norms. 

Figure 3 also ^ives, where applicable, peer group percentile ranking - For 
example, class M,,a health class, achieved a percentile rarfking of 22 but when 
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compared to only students in health programs their ranking rose to the 31s.t. 
Certainly the most aberrant class* average was recorded by .class K, a two hundred 
level science class. The course is part af a. curriculum sequence and tms has 
several prerequisites which affect stude*rt entrA A special computer/un was ■ 

performed to see what effect class ys del^i>9n woulcKhave\pn the to^al group 

/ • / / ' ^/ 

average. The result was a lower groups4iv&an/39.02As 40.83) and a/different 

percentile ranking (38 vs 45)^ A case cO^'dfa^ be made /o view th^Se 

revised resul-ts as a more accurate representation of our studej^ popula.tjon since 

the typicalness ol^ students in class K is cVtainly question 



Writing • - ' 

The* writing test was administered \\ eleven classes/^ 
received frojn 189 students (58.5% of the enrolled 
summarizes the results: 




valid sampl^^ were ^ " 



ts) the .following table 



Class 



T' 



36 



33 



Nuijiber 
Testen 



% 

[esponse^ 



17 



21 



^.2 



63.6 



4.7 



22 



18 



81.8 



-,5.5 



24 



41.6 



30.0 



33 



9.0 



33.3 



32 



31 



96.8 



19.3 



6.4 



11 



12 



44.-4 




8.3 



8.3 



AA\ 



29 



24 



82.7 I 



37.5 



37.5 



8.3 



BB 



29 



15 



13.3 



33.3 



46.6 



28 



13 . 



7.7 



46.1 



38.4 



7.7 



DD 



30- 



25 



4.0 



24.0 » 



48.0 



20.0 



4.0 



ill 



lA 



18.5 



41.2 



19.0 ' 



n.i 



2.6 



1 = 
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Incorppr^iensibye (i .e/ confused expression, words missing, incomplete 
sententes, grass grammatical errors) 



12 



11 ' • 

2. 3 3 = No main idea discernible. 'The' paper possesses many and basic % 
V within sentence errors. 



4 - 5 = T^e main id^JA only adequately communicated and the paper possesses 
6*= An acc^ptS|i|3ivel for academic transfer. ^ Main idea iS^well and 



clearly deveioped but some technical -problems exist 
7 = A good^solid performance 

T 

. ^ 8 = An excellent piece of writing in all ways: clear, precise, interesting 

strong vocabulary 

\ \ labile any numerical scale used to evaluate student writing samples .will be 
I ^ r ' ' ' " ■ , ^ . 

somewhat' artificial , it is important to note that these numbers represent a 

y b * . 

careful assessment of each^ paper. A competent English teacher with wa^e expen- 
ence in correcting themes was chosen ,to correct them. She u^ted as a, guide a 
Cf^iterion check sheet developed by Karen Spring and modified by the feedback . 
from the English department* In point of fact, the assignment of numerical 
values, to the papers was not the result of a cursory reading but rather the ! 
second s^^a in a rather'careful process in which each individual paper wa^^ marked 
^pellidj^p^anniar, punctuation and organizational, and content quali.ty. 

Tq Summarize and review Figure 4, it should be emphasized that the inter- . 
va} values from 0 to 3 identify papers which are totally unacceptable as college 
level writing. Taken together, this represents 25.9% of this student sample. 
In addition, the writing samples evaluated as 4's or 5's, while communicating 
a main idea,. were so sevjferely flawed by grammatical and organizational errors 
as to not qualify as col lege leveT material either. Thu?, the implica'tions 
are that 67^ of -the studtnts sampled by this study are pot writing at a level ' 
Acceptable for collegjg transfer. This may be the most sobering piece of „^ 
tnfomiation to be gathered by this res'earch projeH> 



• . ^ 12 

• ^ . Motivation 



I Again, please recall that /^.selection of E.T.S's Academic Motivation ^cale 
was a working compromise and" ni pretence is ma^e to its validity as a true measure ' . 
of aVtudent's motivation le^eU As this research project continues through the 



• year other facultyjrepOV-ts-Mviybe issued and we expect to have some' data on 
•^ts p.eaict1ve va^au/. i^.r^^^^ relT..e>n -Inventory ou. student 
_ s-ample of 321 achieved cT mean score of\48.43. In more meaningful .terms this 
score is equivalent to the 49th percentile on the Comparative Guidance and 

Placement; Program's national norms. In essence, our student sample seems to be 

/ ■ ^ \ ■ 

• no less mptivated (on the basis -of Academid Motivation Scale) than other average 



\ 
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community college students across the natiort. 

Summary \ 

This first phase of the Stu/dent Assessment .Project has attempted to establish 
a reliable index of, the level of educational preparation of on-campusrday transfer' 
students^ The results of this .study 'tend to validate faculty observations regarding 
the lack ot Adequate educational preparation .s,tudents often demonstrate in class. 
On the basis of the studJnt data presented in this report a large number of 
Seattle Central Community College students in academic transfer classes lack 
competency"^n basic skills. , ^ , 

This research project. will follow this sample of 485 students for the entire 

academic^year. Our goal will be to identify possible^ re la tioKsVips between the 

variables (i.e. age, test scores, motivation, program patteriM^ y^s between'' 

formal educational experience, etc) c|nd performance (i.e. grades, withdrawal 

rates, etc.). As has beer^mentioned, further "faculty reports" will be issued. 

It is sincer^y hoped that such information c^ delimit areas of institutional x 

concern and ini^tlate institutional f^esponses which benefit students. 
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